Exclusive roles
Looking to interview now and have starts on 1/6/2025
9 month project
Onsite Tues-Thurs
Role Summary:
The Data Engineer will be responsible for building and maintaining the data pipelines that process data from CSV files through various transformation stages, following the Architect’s data model designs. This role requires hands-on experience with data transformations, working with large datasets, and implementing robust ETL processes within AWS.
Key Responsibilities:
Develop ETL pipelines to process and transform data across bronze, silver, and gold layers.
Implement data cleansing, validation, and transformation processes to support analytics-ready datasets.
Collaborate with the Sr. Data Engineer and Data Architect to ensure alignment with data models.
Optimize data workflows to improve processing times and resource utilization.
Skills and Qualifications:
Bachelor’s degree in Data Engineering, Computer Science, or related field.
3-5 years of experience in data engineering, preferably within AWS environments.
Proficiency in PySpark, SQL, AWS Glue, and S3.
Strong problem-solving skills and attention to detail.